Integration of visual and linguistic information in spoken language comprehension.

نویسندگان

  • M K Tanenhaus
  • M J Spivey-Knowlton
  • K M Eberhard
  • J C Sedivy
چکیده

Psycholinguists have commonly assumed that as a spoken linguistic message unfolds over time, it is initially structured by a syntactic processing module that is encapsulated from information provided by other perceptual and cognitive systems. To test the effects of relevant visual context on the rapid mental processes that accompany spoken language comprehension, eye movements were recorded with a head-mounted eye-tracking system while subjects followed instructions to manipulate real objects. Visual context influenced spoken word recognition and mediated syntactic processing, even during the earliest moments of language processing.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Early decreases in alpha and gamma band power distinguish linguistic from visual information during spoken sentence comprehension.

Language is often perceived together with visual information. This raises the question on how the brain integrates information conveyed in visual and/or linguistic format during spoken language comprehension. In this study we investigated the dynamics of semantic integration of visual and linguistic information by means of time-frequency analysis of the EEG signal. A modified version of the N40...

متن کامل

The multimodal nature of spoken word processing in the visual world: Testing the predictions of alternative models of multimodal integration

Ambiguity in natural language is ubiquitous (Piantadosi, Tily & Gibson, 2012), yet spoken communication is effective due to integration of information carried in the speech signal with information available in the surrounding multimodal landscape. However, current cognitive models of spoken word recognition and comprehension are underspecified with respect to when and how multimodal information...

متن کامل

The impact of Persian transfer on Kurd learners’ idiom comprehension: parts of body in focus

The present study aims to consider the linguistic influence of official standard Persian language on idiom comprehension focusing on parts of body comprehension of Kurdish EFL learners. Most of the Kurds have studied in schools in which the language spoken or written has been different from their mother tongue. The present study is based on data from 92 EFL learners whom Kurdish is their first ...

متن کامل

Eye Movements and Spoken Language Comprehension

We present an overview of recent work in which eye movements are monitored as people follow spoken instructions to move objects or pictures in a visual workspace. Subjects naturally make saccadic eye-movements to objects that are closely time-locked to relevant information in the instruction. Thus the eye-movements provide a window into the rapid mental processes that underlie spoken language c...

متن کامل

The Bilingual Language Interaction Network for Comprehension of Speech.

During speech comprehension, bilinguals co-activate both of their languages, resulting in cross-linguistic interaction at various levels of processing. This interaction has important consequences for both the structure of the language system and the mechanisms by which the system processes spoken language. Using computational modeling, we can examine how cross-linguistic interaction affects lan...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Science

دوره 268 5217  شماره 

صفحات  -

تاریخ انتشار 1995